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CHAPTER I 
INTRODUCTION 


In tne last few years reliability has tecome of primary 
concern in the development of most large weapon systems. MThis 
growing importance of reliability has produced a great need 
for methods of predicting the overall reliability of these 
systems. Because of the size and Veompllexity of present day 
military weapons system, it is necessary for major contractors 
to have many sub-contractors located throughout the country. 
This fact complicates the problem of formulating a method for 
conpw@eing lower confidence limits on system» reliability where 
the reliability of the system is computed as the product of 
the reliabilities for tne components. 

Recently a system reliability model for computing a 
Llower@eont idence imme ror the reliabiiivyeor weapon systems 
has been developed for the Navy and is contained in "Guide 
Manual for Reliability Measurement Program," NAVJEPS OD 29304, 
15 May 19655. The model was prepared for the Denartment of 
Navy Special Projects Office. Tne document states that the 
model can be utilized by all contractors for subsystem relia~ 
bility measurement and by the Navy for weapon system relia-~ 
Peiity measurement. The model permats the combination of test 
data from all levels (from component to weapon system) and 
types of tests into meaningful component, equipment, and 


Bwosystem failure rates and reliability indices. 


An underlying assumption to this statistical model is 
constant failure rate, i.,e., thev6xnonential failure law is 


assumed to holds: 


wnere 


ee, 
i 


reltvability 


Lefer lukemmeber per miss ion 


It is the purpose of this thesis to examine the accures® 
of the statistical model contained in OD 29304. The investi- 


gation tnat follows will examine the model when 


(1) the failure distribution is other than exponential; 
in particular, wnen failure times have a Rayleigh 
m1 S'Garl pba Oly ine autinercasing failure nate, 
Appendix 1 contains a graph of the Rayleigh distri- 
bution and its failure rate function. 


(2) the failure distribution is a binomial distribution. 


In letter chapters, it widtl be explained tiem une 
1c0(1-«a) percentile of the simulated distribution of the 
lower confidence limit, denoted by ; ee and the true 
reliability of the systen, Ro» should be equal, Tererere, 
the difference will be used as a measure of the accuracy of 
the model. AS an exemple of some of the restive, Gesu. 
the system with 4 components, each having e reliability of 


.995. Samples of sizes of 50 and 500 components were tested 


with a planned test time of 2 mission units. Tne true 
reliability of the systen, Ro» is .9801. Tne 80th percentile 
points of the distribution of the lower confidence limit for 


Rayleigh distributed failure times were computed to be: 


Oo me gd Ay a> Bol 
26 50 957 ,023 
HAE 500 961 019 


when the failure times were binomially distributed and the 
test time was one mission unit, the 80th percentile points of 


the distribution of the lower confidence limit were computed 


to bes: 
a Ny Ay 4 Ay ~qg 7 Rg 
Ae) 50 9683 , Ole 
PAG 500 ,9300 OOO) 


Chapter II contains a complete explanation of the 
statistical model in OD 29304. Chapter III discusses the 
Simulation procedures and presents the simulation results. 
It also discusses the two methods used to determine the 
accuracy of the model. Chapter IV discusses and summarizes 


the results and states the conclusions. 


\O 


CHAPTER ITI 
HAPLANATION OF STATISTICAL MODEL (1) 


If a system consists of k components in logical series, 


tne true system reliability, Ra» may be expressed as 
n= || 8 (2) 


wWiGic wre 15. twe true reliability Of the ith componciaa 
i 
It is desired to find a lower 100(1-a!% confidence 


A 
limit for R.. That is, a statistic R. such tnat what- 


s,L(a) 
ever the actual values of R, es |e, eon 


PLR, 2B, 1 (q)J = 1l-a (3) 


The proposed method to find this lower 100(1-a)% 
confidence limit for Re as outlined in OD 29304 will be »re- 


sented belot; to include: 


(1) Overating assumptions, 
(2) Estimation of failure rates. 
(3) Statistical equations for confidence limits on 


failure rates and reliability. 


Onerating, AsSSuilptTions 
Tie reliability measurement system described in OD 29304 
is predicated upon the general reasonableness of the follow- 


ing assumptions: 


10 


(1) Constant Failure Rate ~ the exnonential failure law 
is assumed to hold. 

(2) Addytivity of Stress Effects"="the failwire Fate in- 
duced by two simultaneously acting stresses is 
equal to the sum of the failure rates due to the 
two S~réeésses acting séquentially. This assumption 
permits adding data from single environment tests 
COpeTHerw LO Sinulate mission exverience. 

(3) Independence of Comvonent Failures ~ independence 
of component failures is assumed because components 
are normal lyetested andiivaduadeiyeby TCypes and sub- 
system reliability is estimated using component and 
other applicable test results (e.g., equipment and 
subsystem). 

(4) Failure Rate Constancy - the failure rate is con- 
sidered a function of only the stréss acting. In 


other words, the item under test has no memory. 


Estimation of Failure Rates 
Under tne above assumptions, if component 1 has failure 


rate x and comoonent 2 has failure rate ho» taecn the 


Ae 
Poeressonding tdailure rete Tor tUme simple serial subsysten 


1s: 
(4) 


Pence Cie mode Gf Testing generally cmployed. by subsystem 
contractors is to test until some planned test time, the 


A 
PAidure rate estinates, da COntaimebieas. Tnerefore, an 


ae 


unbiased failure rate estimate has been developed in OD 29304 


and is given as 


wnere 


n, = sample sizes for thesith components i.e., the 
number of tests conducted on component i. 

S, = the sum of all test times accumulated on the 
mn components of type i. 

f= number of componentsi of type 4 that did not 
complete their mission, 1i.e., failure time 


was less than the planned test time. 


Under the OD 29304 method, failure rate estimates for 
subsystem reliability can be calculated from component, 
component-environment, or compnonent-environment-test con- 


dition level data, That is 


A » A 6 
A\component = 4 Acomponent-environment (6) 
A A 

equipment = 2 Acomponent 7 
‘ a5 (8) 
‘subsystem ~ 4 “souipment 


It permits the combination of test data from all levels 
(from component to weapon system) and types of tests into 


meaningful component, equipnent, and subsystem failure rates. 


lé2 


Statistical Equations 

All statistical estimates, based as they are upon 
fragmentary date, ere subject to statistical uncertainty. 

In reliability work, it is usually of interest to compute 
upper limits on the failure rate and corresponding lower 
Limits on the reliability. The following statistical equa- 
wlons TOr Calcularuwon Of tne Pewer confidence limit are 
based on normal theory and have been corrected to compensate 
for small values of i. Detailed derivations of these 
MOTMUMAS “anes CONUaimedmin Gererence. |. 

The method proposed is to put n, items of component 
lemeyal test ede tne senvironmentvalsconditions defined in the 
messiepeena let cach operatesuntil fablumer or tae planned 
test time, whicnever occurs first. All time is measured in 
mission units. Tnen an umbiased estimate of failure rate, 
7 for each component i is obtained from equation (5). 
If failures have occured for any of the i components, an 


uoper Limit on failure rate can be calculated as follows: 


A A A 2A AZ 
A _ 2dr + ( K)<C + N4A (8K) C + (BK +6 
ae i) 
iE a 
Waere 
A KA 
Ne (10) 
abe 1 
A .\ / 
c= Sa § (11) 
r 
K = (l-a)th percentile of the normal distribution 


13 


B = correction factor; Table 1 shows avnropriate 
beta values for the @Cth vercent confidence 


dtiindiats 


nen no failures Wave occurred, tne upper 1 iit ome fallaee 


rove TS 





Vite Be 


k = number of components in the simulations 
S, = tne sum Of all test vimes accunulavem@® cnmewen— 


NM components of type 1 
ii 


Substitution of the upper Jimits on tne failure raves 
previously obtained will generate corresponding lower con- 


fidenee limits on reliability: thus: 


A 
3 = ory (13) 
“SL (ou 


To determine the accuracy of tne above model, one needs 


A 
to look at tac coaraceemirstics Of s& LI ‘i By defini Gilew, 
Sy 
A 
R is a lower 100(1-3)% confidence limit for R , tine 
S,L(a) S 


systen reliability; i.e., from equation (3) 


A 
PLR eee! 


S jill: ) 


Tiis says that R is always the (1l-a)th percentile point 
Ss 


A 
of the probability distribution of Re . nus if We 


»L(a) 


14 


A 
Consumuct the distribution of R by computer simulation, 


eel, ) 
we should find that the (l-a)th percentile point of our 
Construccved d¥sevrroution ws Ros Po Comoro | 3) seen Cce bs 


AN 
i.e.,if infact R. jis a true 100(1-a)% lower confi- 
oral 9 


ee 
dence limit for Rs- 


Thus a measure for the accuracy of the model is 


where 


A = (l-a)th percentile point of the distri- 
a 


A 
bUbLOn Olen 
Salina) 


It equa Gale >) lisMcorpmect, thems should equal Ho 


l-a 


TABLE 1 


BETA VALUES FOR 80% CONFIDENCE LIMIT 





\O Om ON WN i WW vue 
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CHAPTER III 
SIMULATION PROCHEDURE AND RESULTS 


In order to evaluate the accuracy of the OD 29304 model, 
a computer program was written and used to simulate tne 


GigtYribution of 4 Tre distribution is constructed on 


%,L(a)°* 


A 
a computer by generating 500 values of R 
s,L(a) 


set of parameter values k, n, (L=1,2,...,k), Ry 


Toy (i= 1,2,...,K), and a given failure distribution; i.e., 


A 
R ig a function of 
8,L(a) 


for a given 


(l=1,2;.. ign 


k: mumber of components in the system 

n,: number of items of component i tested 
A reliability of component i 

T .: planned test time for component i 

ta 


, fb): failure distribution for component i 


Wien a failure distribution for component i is specified, 
the computer program generates 500 random failure time 
variates, T), (3 =1,2,...5500), for component i. If the gener- 
ated time variate is less than the planned test time, ee. a 
failure is "counted" by the computer. With the total number 
of failures, By counted for a set of 500 generated failure 
times, the comvouter program then computes the failure rate 


A 
for component i, i from equation (5). The above procedure 


‘i 
is repeated for each component i, and the corresponding 

A 
upper limit on the system failure rate, A,,, is then calculated 


from equations (9), (10), and (11). With this value of the 


16 


system failure rate, the lower confidence limit on the 

A 

system reliability, R 

3 S,L(a)’ 

The above procedure is replicated, giving 500 values of 
A 


Re »L(a)° 
subroutine, and the computer "picks" the (l-a)th percentile 


is computed from equation (13). 
Tnese 500 values are then ordered by a separate 


of these 500 values, denoted by A Tnois value is then 


l-a’ 
compared with the true system reliability Roe 

The above simulation procedure was carried out for tne 
following two methods; 

(1) Rayleigh distributed failure times 


(2) Binomial distributed failure times 


Rayleigh Distributed Failure Times 

Since the Rayleign distribution is a one parameter 
distribution (see appendix 1), it was decided to choose the 
value of this parameter (a) such that the reliability of a 


component for one mission unit is .995; 1.e., 
R, (1) = PLT, , >1] = 9995 (14) 


The determination of the value of this parameter is shown in 
appendix 2. The resulting failure time distribution that 


will be assumed for each component i in the simulation is: 


Eo 


f (t,a) = +, te Bae iene Onmiti) XO (15) 
a 


i 


For Rayleigh distributed failure times, the accuracy of the 


model was examined for five cases: 


— 
© 
§0 
9) 
@ 
_— 
tH 

1 


Oe nlesioM mits 


Oj 
(2) Case 2; es 1.0 mission units 
(3) Case 3: ile ie eer OMe Un Csr Ls llega 
des FS eM SON VNLS jd te OEP 
(4) Case 4; To4 = 2.0 mission units 


CS )waiCagic =): Toy =- 5,0 mission units 


Determining the Case 4 planned test time, To4. is shown in 
appendix 2, For each case, the number of components k was 
equal to 4, the reliability &, was equal to .995, and 
various values of n, were used, The cases are numbered and 
the results shown in Table 2, The mean and variance of tne 


A 
distribution of R (0) are also shown in Table 2. ‘The 


S,L 
quantity lebeled TT in Table 2. is expressed by 


k 
Tt = joe (15) 
f=] ik 


where 


4 =i-k, = the unreliability of component 1 


aL 


Tois quantity, TT, is a function of the amount of testing 
relative to the unreliability or failure rate, The results 
of the cases in Table e@ imply that the model is more 


accurate as TT increases, 


Binomial Distributed Failure Times 


A 
For this method, the failure rate for component i, hy 


18 





is given as 


A A t. 
Dae IE?) 
iL 
wnere 
LO = Humber of Componemmes of type a that failed 
n, = number of items of component i tested 


Using a uniform random number generator, the computer 
generates a uniform random value between O and 1 for com- 
vonent i. If tne value is greater than Rs a failure is 


"counted" by the computer. This procedure is repeated nn 


titess1 Or each Hy and for each component i. Thus tne nun-~ 


ber of failures counted divided by n, becomes an estimate 
Ofeiune failure rate formeompenene es as) given by equavion 
(17) above. This process is repeated for all components. 
With these estimates, \,, the computer simulation determines 


A and calculates the mean and variance of the 500 


Ll-a 


values of R as previously explained. 


s,L(a) 
For this method, the accuracy of the model was exam- 


imed for three cases; 


(1) Case ls: R = .995 


i 
(2) Case 2; R, = ,950 
(3) Case 3: RB, = .900 


Tne sum of the failure times, S was set equal to to n,5 1.€.5 


3 


3. = 
oe 


dee : = ii 5 1 = HE Cig) oweheeen (12) 


My 
a 5 al 


the number of components k was eausl to 4, and various 
values of n, were used, THe Gases are numbered and the 
results snown in Table 3. Again, tne quantity, TT, is 


also wisved in -Teole 63, 
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GES aad AEs Son OE 
SUMMARY AND CONCLUSIONS 


It was stated previously that a measure of the accuracy 


of the model was given by 


A) Lg - _ 


where A, ~ jigeeae (1-ca)epercentilespoint of thesedistri- 
; A ; ‘ ee 

pal ion- of Rs jL(a)? and Re Hs the trueereliability of tne 

system. For the Rayleigh distributed failure times, this 


measure for tne various cases is snown below for Re equal 


BO .995. 


a n It A - R 





ou on z= Ss Ll+2 s 
Ons 20 50 0995 043 
100 ~995 Cal2 
500 5) 5)5) .008 
i ng n2U 100 0995 s One 
300 (905 .003 
500 995 AOC, 
230 WA 50 995 02s 
100 995 ~019 
500 995 mdi, 
Dal me 50 7D Ore 
100 eh mean 
500 .995 gi Oil 


ihe above results bring out some rather interesting points. 


iit thesplauned testetime, T Nema nec at eumodcilimsciales 


on 
bessimistic results; i.¢e., the accuracy is not very good, 
regardless of the sample size nie However, if the planned 


teat tame is small, the acewracy of the model is very good 


ae 


if a large sample of a particular component is tested. In 
other words, for small planned test times, the accuracy 
of the medel_is very gead when the quantity, Lh, i @reater 
tae “oO 

For the Binomially distributed failure times, the 


accuracy of tne model for tne various cases is given below. 





—— S an _— Ss 
.20 .980 25 043 
980 50 fOl 
“C0 100 O10 
.980 500 ~ 000 
.20 ~950 AS 2013 
mS a8 50 .008 
~950 100 .004 
0950 500 ~OOL 
AG) ~900 25 Pens 
© 900 50 004 
~900 100 giibZ 
~900 SCO 0 Oak 


ne results. eleariy snow Chat the accuracy of the ~weder is 
extremely mood, especially when the sample size, ns» is 
large. 

Obviously, the maim reason fer the results in the ease 
of Rayleigh distributed failure times is the fact that the 
components nave increasime failure rates. The underl gang 
assumption in this model is that components under test have 
a constant failure rate. In practical applications, many 
components follow this assumption reasonably well, when 
infant mortality failures are deleted and wearout failures 
are not anticipated during the mission duration. However, 


if a new component is being tested, a constant failure rate 


24 


may not be reasonable at all. Therefore, when this model 
is being used to obtain a lower confidence limit on the 
reliability of a weapon system, and it is known that a 
particular component has an increasing failure rate, tnen 
the points brought out above as a result of the simulation 


Should be taken into consideration, 


25 
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APPENDIX 1 
RAYLEIGH DISTRIBUTION 





2 
tt die 
a 2 = 
PDF: F(t) = * er CDF: F(t) = l-e a 
a 
BR (failure rate) z(t) = = (increasing failure rate) 
a 
f(t) 
06 
A015: 
O04 a 
03 
102 
Ol 
2 4 6 8 10 2 WwW 1 18 2 22 wm ‘t 
Probability Density Function 
z(t.) 
30 
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APPENDIX 2 


Value of Paranietver Tor™kaylcipw® Drstarpution 


Tne value of the parameter, a, Was chosen such that 


eit) 


" Pied, = —2oe5 (18 


tI 


where 

nti 

2ak 

ee) = (20) 


i 


B, (t) 


Equating equations (19) and (20), we obtain 


aL 
4208 
€ = 995 > t= 1 (21) 
or 
2 a 
— a ee Le 
4 2(in .995) —_ 
hence 
a= 10 


Planned Test Time (TO 4) for Case 4 


ne Case 4 planned test time was chosen such that a 


satisfied the following equations 
TOA 
i \ ztjat = 2(1) (23) 
To4 k 


28 


Wileme 
— t t 
Ate) = ae (24) 
2 
a 
Tnis value of TO4 makes the "average" value of Z(t) between 


o and rt equal Z(1). Setting t = 1 in equation (24) and 


equating (23) and (24) gives 


Thitea, 
op 
Toi a a 
O 
or 
2 
ieee 
— ep = 4 (26) 
oi \ 2a 2, 
lence 
TO4 = 2.0 
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APPENDIX 3 
COMPUTER PROGRAM 


DIMENSTON PT(4,3).RSL(500),4(3),RSBAR(3),SRS(3), 

BETA(30),RS1(3),RSLBAR(3),RS(500).9(4),NM(4) 

BEAD ($6529) @it@) ,J = 1, 44).o( BBA (kK) k= 1980), (26a 
10 FORMAT(4I4/168F5.3/1L4F5. 3/46. 3) 

TPR = URN(0O) 

DO 999 = 1,4 

SS = NM(K) 

Sheik) = 0¢0 


oO 


0 
& 
* F2)/(2.0 « F2) + 1.0) 


This loop generates 500 time variates for each component 


po 900 M = 1,500 
FS = 0.0 

VU = 0.0 

e= 050 

Vl = 0.0 

RSL(M) = 0.0 
RS(M) = 0.0 

DO 800 I= 1,4 
FF = 0.0 

VL = 0.0 

NL = NM(K) 

DO 700 J = 1,NL 
TPR = URN(1 
IFP(TPR Ser. 3(1))G0 TO G05 
GO TO 760 


605 FF = FF + 1.0 
700 Continue 


VL = Bevp2 
Vil = V1 # VI 
PSe= FSe+- iF 


C= Coe (Vigs) 
VU vue (oy oo) 
800 CONTINUE 


A 
This statement computes 4 value of Ro = € 


RS(M) = EXP(-V1) 

RSBAR(K) = RSBAR(K) + RS(M) 
IF(FS .GT, 0.0)GO TO 842 
BY Ave Bara (1) 

VU = (VU#BIA)#(BIAx.177241 ) 
Go tore32 


30 


3) ae Oe Oy At 
Teens . Gey 30se GO" 10-320 
ibs == eer 10 
BTA = BETA(LL) 
Gee tO2G2> 
SIO) EUAN 18 
825 Be = (BLA * . 708964) * BTA 


D= ((4.0 # VL)#(B2xC)) + ((B2eB2)#(CxC)) 
D = S2RT(D) 
VU = (((2.0 « V1) + (B2*C)) + D)/(2.0) " 


A -X 
This statement comoutes a value of RB 2 
+ Save ta 


832 RSL(M) = EXP(-VU) 
RSLBAR(K) = RSLBAR(K) + RSL(M) 
900 CONTINUE 


JWaKe! fo ot ne statements compute the mean and variance of 


A 
R. and R : 
S S,L 


RSBAR(K) = RSBAR(K)/500.0 

RBAR = RSBAR(K) 

DO 905 M = 1,500 

SRS(kK) = SRS(h) + (RS(M) - RBAR)+*2 
905 CONTINUE 

SRS(K) = SQRT(SRS(K)/500.0) 

RSLBAR(K) = RSLBAR(K)/500.0 

RLBAR = RSLBAR(K) 

DO 2410 J = 1,500 

SRSL(K) = SRSL(K) + (RSL(J) - RSBAR)#x2 
2410 CONTINUE 

SRSintio =] Sent Seok) 7500.0) 


A 
Tie following statements order the 500 values of Re iL and 
picks the 80th percentile of the 500 values, Dee | 


ee 
DORIC ae 1... 101. 
TEMP = RSL(1) 
Dopo bo7) <= 14500 
IF(TEMP - RSL(J))916,915,915 
916 TEMP = RSL(J) 
il= J 
915 CONTINUE 
RSL(ii) = 0.0 
Ate TEMP 
9.0 CONTINUE 
ne following statements print out the results- al » mean 
and standard deviation of R, ,, and the mean and tatidard 
deviation of R.. - 


au 


NRITE(6,1010) A(K),RSLBAR(K),SRSL(K),RSBAR(K),SRS(K) 
1010 FORMAT(//6F13.5) 
999 CONTINUE 
END 
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